Running head: SHAPES AND SOUNDS Shapes and sounds: An exploration of audiovisual crossmodality
نویسندگان
چکیده
An initial exploration of the relationship between harmonic timbre and visual form, the following study extends the work of Wolfgang Kohler’s 1929 study by using nonspeech sounds. Although previous studies have examined the relationship between language and shape, there has been little work investigating which properties of the acoustical signal contribute to the crossmodal linkage of auditory and visual forms. The current study indicates that listeners associate pure tones to the rounded visual object and complex tones to the more angular object, suggesting that the linkage between auditory and visual abstraction may have a deeper basis than language development, relating to the actual properties of the acoustical signal itself.
منابع مشابه
Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions
We report on The Manual Input Sessions, a series of audiovisual vignettes which probe the expressive possibilities of free-form hand gestures. Performed on a hybrid projection system which combines a traditional analog overhead projector and a digital PC video projector, our vision-based software instruments generate dynamic sounds and graphics solely in response to the forms and movements of t...
متن کاملAudiovisual correspondence between musical timbre and visual shapes
This article investigates the cross-modal correspondences between musical timbre and shapes. Previously, such features as pitch, loudness, light intensity, visual size, and color characteristics have mostly been used in studies of audio-visual correspondences. Moreover, in most studies, simple stimuli e.g., simple tones have been utilized. In this experiment, 23 musical sounds varying in fundam...
متن کاملFrom sound to shape: auditory perception of drawing movements.
This study investigates the human ability to perceive biological movements through friction sounds produced by drawings and, furthermore, the ability to recover drawn shapes from the friction sounds generated. In a first experiment, friction sounds, real-time synthesized and modulated by the velocity profile of the drawing gesture, revealed that subjects associated a biological movement to thos...
متن کاملA tripartite trans-modal relationship among sounds, shapes and emotions: A case of abrupt modulation
The current project is a case study–and an extension–of the traditional investigation into sound symbolism (Hinton et al., 1994). Several studies have shown that certain sounds evoke images of particular shapes; for example, oral stop consonants are often associated with angular shapes, whereas sonorants (nasals, liquids, and glides) are associated with round shapes (Berlin, 2006; Köhler, 1947)...
متن کاملMonkeys match and tally quantities across senses.
We report here that monkeys can actively match the number of sounds they hear to the number of shapes they see and present the first evidence that monkeys sum over sounds and sights. In Experiment 1, two monkeys were trained to choose a simultaneous array of 1-9 squares that numerically matched a sample sequence of shapes or sounds. Monkeys numerically matched across (audio-visual) and within (...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011